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Abstract 

Purpose: To compare semi-quantitative (SQ) and pharmacokinetic (PK) parameters for analysis of dynamic contrast 
enhanced MR data (DCE-MRI) and investigate error-propagation in SQ parameters. 

Methods: Clinical data was collected from five patients with type 2-neurofibromatosis (NF2) receiving anti-angiogenic 
therapy for rapidly growing vestibular schwannoma (VS). There were 7 VS and 5 meningiomas. Patients were scanned prior 
to therapy and at days 3 and 90 of treatment. Data was collected using a dual injection technique to permit direct 
comparison of SQ and PK parameters. Monte Carlo modeling was performed to assess potential measurement errors in SQ 
parameters in persistent, washout, and weakly enhancing tissues. The simulation predictions for five semi-quantitative 
parameters were tested using the clinical DCE-MRI data. 

Results:\n VS, SQ parameters and K trans showed close correlation and demonstrated similar therapy induced reductions. In 
meningioma, only the denoised Signal Enhancement Ratio (R se i/se2(DN)) showed a significant therapy induced reduction 
(p<0.05). Simulation demonstrated: 1) Precision of SQ metrics normalized to the pre-contrast-baseline values (MSE re | and 
^MSE re |) is improved by use of an averaged value from multiple baseline scans; 2) signal enhancement ratio R mse i/mse2 
shows considerable susceptibility to noise; 3) removal of outlier values to produce a new parameter, R m sei/mse2(DN)/ improves 
precision and sensitivity to therapy induced changes. Direct comparison of in-vivo analysis with Monte Carlo simulation 
supported the simulation predicted error distributions of semi-quantitative metrics. 

Conclusion: PK and SQ parameters showed similar sensitivity to anti-angiogenic therapy induced changes in VS. Modeling 
studies confirmed the benefits of averaging baseline signal from multiple images for normalized SQ metrics and 
demonstrated poor noise tolerance in the widely used signal enhancement ratio, which is corrected by removal of outlier 
values. 
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Introduction 

Analysis of dynamic contrast enhanced MRI (DCE-MRI) data 
is commonly performed by applying pharmacokinetic (PK) models 
to changes in contrast agent concentration derived from observed 
changes in signal intensity (SI). A simpler approach is to perform 
direct analysis of changes in SI using one or more of a range of 
established semi-quantitative (SQ) descriptors. 

Almost all early DCE-MRI studies employed simple SQ, metrics 
derived by mathematical analysis of observed Si-time course data 
(SI-TC). With the growth of PK approaches the field has become 
dichotomized with consensus groups recommending PK analysis 
[1,2,3,4] whilst, at the same time clinical radiologists are far more 
likely to use SQ metrics which have become essential clinical tools 
across a range of oncological applications [5,6,7,8,9,10,11, 



12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27]. This wide- 
spread adoption of SQ metrics reflects the simplicity of the 
approach, the ability to use straightforward, often slow, dynamic 
acquisition sequences with good spatial resolution and coverage, 
the wide availability of clinical analysis software and, most 
importandy, clear clinical evidence that the techniques are 
beneficial. 

Despite widespread clinical adoption SQ parameters are 
commonly avoided for clinical trial applications in the belief that 
they are less biologically specific and more prone to variability 
than parameters derived from PK modeling, [2,4] although, no 
detailed study of the behavior of SQ parameters or direct 
comparison of SQand PK parameters has been presented. Many 
studies have however shown significant problems associated with 
PK derived parameters arising from the need for high temporal 
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Figure 1 . Shows examples of the three typical kinetic enhancement curves used for modelling, curve I (persistent type), curve II (washout 
type), and curve III (weak enhancement), (a-c) demonstrate the [Gd] curves fitted with the modified Tofts model using the ICR-DICE method. The 
fitted kinetic parameter values are given above each curve. The small panel at the up-right corner of (c) shows the SI curves from the corresponding 
region in the high-temporal resolution (Af = 1 s) pre-bolus data set of the ICR-DICE acquisition, (d-f) demonstrate the SI curves converted from the 
fitted [Gd] curves. A 1 -minute temporal resolution was used to extract data from the theoretical SI curves (showed as asterisk points), which are used 
as the 'true' SI enhancing curves in the following Monte Carlo simulations. 
doi:1 0.1 371 /journal.pone.0090300.g001 



resolution sampling, accurate arterial input function definition and 
problems associated with curve fitting based analysis approaches 
which are limiting widespread implementation of DCE-MRI, 
particularly into multi-center studies [4,28,29,30]. 

The signal enhancement ratio (Rmsei/mse2) is particularly 
attractive SQ metric which is little affected by variation in tissue 
T 10 values and has been shown to correlate closely with the 
redistribution rate constant (k,. v ), a commonly analyzed PK 
parameter [31]. This behavior identifies R mse i/mse:2 as a potential 
simple and attractive surrogate of PK analyses, which has led to 
widespread adoption, particularly in breast cancer studies 
[9,10,11,12,13,32,33,34,35,36]. 

Anxieties around the use of SQ_ parameters for quantitative 
studies have little or no substantive evidence base [37]. Multicen- 
ter clinical applications are common and the development of 
"normalized" SQ_ metrics represents an attempt to minimize 
variation across multi-center/ multivendor acquisitions. Wider use 
of SQ_ parameters for clinical trials and multicenter studies would 
simplify data analysis and potentially improve implementation of 
DCE-MRI. However, before this could occur it is essential that we 
have a greater understanding of their ability to identify therapy 
induced changes, the comparative performance of SQ_ and PK 
derived biomarkers and their variability in the setting of 
multicenter studies. 

Direct comparison of SQ_ and PK parameters is complicated by 
the differing acquisition approaches employed. SQ, parameters are 



typically used in low temporal resolution data allowing the use of 
high spatial resolution and large volume coverage. In contrast, PK 
parameters depend on high temporal resolution to allow accurate 
fitting of the analytical model, which produces compromises in 
both spatial resolution and coverage. We have recently described a 
dual injection technique, ICR-DICE (Improved Contrast and 
spatial Resolution using Dual Injection Conrast Enhanced MRI) 
[38]. This uses two separate contrast enhanced dynamic acqui- 
sitions to provide a high temporal resolution dataset, ideal for 
identification of an arterial input function for PK mapping, and a 
high spatial resolution dataset for measurement of tissue residue 
functions allowing direct, pixel by pixel comparison of SQ_ and PK 
metrics in the same dataset. 

This study uses a combination of Monte Carlo modeling and 
clinical ICR-DICE data from patients with type 2 Neurofibroma- 
tosis and was designed to address five basic issues: 

1 . What is the predicted effect of variations in signal intensity 
curve shape and signal to noise ratio on errors in the estimates 
of SQ parameters? 

2. Do observations from the clinical DCE-MRI data support 
Monte-Carlo predictions? 

3. Does the behavior of the signal enhancement ratio (R mS ei/mse2) 
provide a satisfactory surrogate metric for formal PK based 
analyses? 
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Figure 2. Shows fitting results for Experimental and modelled signal enhancement data Sl(f). Experimental data are shown with symbols 
of "+". Modeled data are shown as a solid line. The good fits (left column) are characterized by a lower (near zero) 'Mean Ar 2 _ 30 ' and a higher fraction 
of modeling information (FMI) [47], where Ar is the autocorrelation of the residual, and the 'Mean Ar 2 _ 30 ' was the mean Ar over the time lags 2 to 30. 
The poor fits with considerable modeling error (right column) are characterized by a higher 'Mean Ar 2 _ 30 ' and a lower FMI. 
doi:1 0.1 371 /journal.pone.0090300.g002 



4. What is the optimal number of samples to define pre- 
enhancement signal intensity on estimates of SQ_ parameters? 

5. How do SQ_and PK derived metrics compare in the detection 
of anti-angiogenic therapy induced changes in a single centre 
setting? 

Methods 

Choice of Semi-Quantitative Parameters 

Candidate SQ,parameters were categorized into 5 groups, each 
characterized by a similar mechanism of error propagation during 
parameter calculation. An additional novel parameter, designed to 
improve computational stability, was subsequently added. The 
final 6 SQ, parameters were: 

1. Absolute MRI signal enhancement (MSE) [39], (e.g., MSE lmin = - 
SIimin, P ost-SI pre ), where SI lminpost is signal intensity at one 
minute post contrast agent (CA) injection and SI pre is SI pre- 
injection. One commonly used example of this category is the 
maximum intensity change per time interval ratio (MITR) 
[40]. 

2. Relative signal enhancement (MSE rel ) [14,22,41] which uses a 
baseline value for normalization in order to reduce the 
dependence on biological and imaging system variables, e.g., 

MSE rel> Imin = (Sllmi, post - SIpre) /SIpre, where MSE rel; lmin is 

MSE re ] at one minute post CA injection. 

3. The sum of MSE over a fixed post-injection duration, Q^MSE). which 
can also be defined as the area under the enhancement curve 
(AUC) [1]. 

4. The sum of MSE, d over a fixed post-injection duration, (^MSE rel ), 
which can also be defined as baseline-normalized AUC [1]. 



5. Signal enhancement ratio, (R mse i/mse2) commonly defined as the 
ratio of early to late contrast enhancement ratio [32], e.g., 
Rmsei/mse2 — (SIi m i n post - SIpre)/ (Sl5 m i n post - SI pr e); Alternative- 
ly, defined as the ratio of late to early contrast enhancement, 

Rmse2/msel — (Sl5 m in post - SIpre) /(SI lmin post - SIp re ) 5 which 

was also coined the name of SER (Signal Enhancement Ratio). 

6. Demised Signal enhancement ratio (R mS ei/mse2(DN) Comparison of 
values in msel, mse2, and R mS ei/mse2 maps demonstrated that 
3-4% of voxels have spurious values resulting from noise- 
induced near-zero values in mse2 maps whereas msel 7^0. To 
remove these oudiers, thresholds of 0<R m s <: i/ m se2 <; l-45 were 
used to exclude voxels outside the 95th percentile and R mS ei/ 
mse2 calculated as described above. Note that a median filter 
could be used to filter oudiers, but may also affect high 
frequency components of the SER maps [42]. 

Monte-Carlo Modeling of Measurement Errors 

Generation of typical signal intensity-time course 
curves. Three patterns of signal intensity time course curves 
(SI-TC) were chosen for Monte-Carlo analysis [19]: 1) persistent 
enhancement, 2) contrast washout, and 3) weak contrast 
enhancement. These represent the three principle variants that 
have biological value in published studies of SQ, parameters. 
Examples of each type were identified in high-spatial resolution 
DCE-MRI data of a vestibular schwannoma (VS) in one patient 
(vide infra). These exemplar signal-time course curves were used to 
generate a tissue model by: 

1 . Converting SI-TC to contrast concentration time course curves 
(CC-TC). 

2. Fitting with the modified Tofts model [43,44]. 
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Table 1. Descriptive statistics for PD distributions calculated from 10 6 Monte Carlo repetitions for each of the five SQ parameters 
under varying noise and pharmacokinetic conditions. 
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3. Generating synthetic Si-time curves from the derived fitting 
parameters using measured baseline SI and pre-contrast Tl 
relaxation time (T 10 ), and a literature value of the longitudinal 
relaxivity of the contrast medium (4.39 mM 1 sec ) [45] 
(Figs la-c). 

4. Sampling the synthetic time course data with a 1 -minute 
temporal resolution for use as "ground truth" signal intensity- 
time course curves (SI-TC) in subsequent Monte Carlo 
analyses (Figs 1 d-f). 

Monte Carlo simulation for error analysis. MSEij,,^, 
MSE r<:1 lmin , J^MSE, ^MSE rrf and R mse i/ mse 2> were calculated for 
each of the reconstructed Si-time curves to produce 'true' values 
(where msel =MSE lmin , mse2 = MSE 3m ; n and the sum of MSE 
and MSE re i were performed over a 5 minute duration). Rician 
white noise with noise levels ( = standard deviation/ mean baseline 
signal) of 5%, 10%, and 15% was subsequently added to the 
simulated SI-TC and SQ, parameters calculated to produce 
'measured' values. A total of 10 s repetitions were performed for 
each given condition (i.e., a specific SI-TC type), and a given noise 
level. Percent deviations (PD) of the 'measured' from 'true' values 
were calculated. Frequency distributions of the percentage 
deviations were displayed as histograms and distribution charac- 
teristics including measures of distribution position (the mean and 
the median), dispersion (the range, percentiles, and SD), skewness, 
and kurtosis were calculated. Rank statistics (the range, the 5 th and 
95 th percentiles, and the median) of the PD distributions were 
displayed using box-and-whisker plots. 

Monte Carlo simulation for optimal number of pre- 
contrast time points. The use of a mean value of multiple pre- 
contrast time points as SI pre for calculation of SQ_ parameters will 
reduce the effects of noise and improve reliability [46]. To 
determine the optimal number of the pre-contrast time points, the 
above Monte Carlo simulation was repeated but with varying 
number of pre-contrast time points based on 15% noise level (a 
typical noise level in our data). 10 4 repetitions were performed for 



each given condition (i.e., a specific SI-TC type), and a given 
number of pre-contrast time points. 

Clinical Studies 

Ethical statement. The clinical study received approval 
from the NHS Health Research Authority National Research 
Ethics Service, North West Committee, Greater Manchester 
Central, Rec Reference 13/NW/0131 and all patients gave 
written informed consent for inclusion in the study. All imaging 
data is archived within the CRUK-EPSRC cancer imaging centre 
in Cambridge and Manchester archival database and is available 
to external investigators in anonymized form. 

Clinical data acquisition. DCE-MRI data were collected in 
five patients with type 2 neurofibromatosis (NF2), with a total of 12 
tumors (7 vestibular schwannoma (VS) and 5 meningiomas). 
Patients were treated with the anti-vascular endothelial growth 
factor antibody bevacizumab (5 mg/kg fortnighdy, Avastin, Hoff- 
man La-Roche, CH) and were imaged on 3 occasions: pre- 
treatment (day 0), 3 days (day 3), and 3 months (day 90) following 
treatment. 

DCE-MRI data were collected as described previously [38] 
using a dual injection technique with an initial high-temporal 
resolution (1 s), low-spatial resolution acquisition for measurement 
of the arterial input function followed by a low-temporal, high- 
spatial resolution (voxel size =1x1x2 mm) acquisition for 
measurement of the tissue residue function. Contrast agent (CA; 
gadoterate meglumine; Dotarem, Geurbet S.A.) was administered 
by power injector as an intravenous bolus at a rate of 3 ml/ s, 
followed by a chaser of 20 mis of 0.9% saline administered at the 
same rate. A low dose of CA (0.017 mmol/kg) was used for the 
first, high temporal resolution acquisition. For the second, high 
spatial resolution acquisition a standard dose (0.1 mmol/kg) was 
administered synchronized with 7 th frame of the dynamic 
acquision yielding six pre-contrast time points in each SI(t) curve. 



PLOS ONE | www.plosone.org 



4 



March 2014 | Volume 9 | Issue 3 | e90300 



Semi-Quantitative Metrics for DCE-MRI 



Curve I (Persistent Type) 



Curve II (Washout Type) 



Curve III (Weak Type) 



^5 






160 




C 


120 


o 






80 






> 


40 


cd 




Q 


0 




-40 


"ce 


-80 


CD 


-120 


CD 


-160 


D. 



ENR = 21.6 



160 

120 

80 

40 

0 

-40 

-80 

-120 

-160 
ENR 



22.1 



MSE 
MSE r6 



IMSE 
SMSE„ 



400 
300 
200 
100 
0 

-100 

-200 

-300 

-400 
ENR 



(6E4) 



5.3 



(-2E5) 



160 

120 

80 

40 

0 

-40 

-80 

-120 

-160 
ENR : 



(282) (230) 




10.8 



160 

120 

80 

40 

0 

-40 

-80 

-120 

-160 
ENR 



(217) (277) (6E3) 



— i— r 

— • • 4 

T L 


F — - 







11.1 



(-6E4) 



400 
300 
200 
100 
0 

-100 

-200 

-300 

-400 
ENR 



(526) (555) (1E8) 











— • 1 

T L 


* 

r 1 


• 




— i 1 * — 



2.6 



(-1E7) 



160 
120 
80 
40 

0 T 
-40 
-80 
-120 
-160 
ENR = 7.2 

a. simulation 



(985) (802) (327) 



(-572) 



160 
120 
80 
40 
0 
-40 
-80 
-120 
-160 
ENR 



(758) (970) (1E6) 



7.4 



(-7E6) 



400 
300 
200 
100 
0 

-100 
-200 
-300 
-400 
ENR 



(414) (1E3) (1E3) (2E8) 

























— ■ i 


* — i 


> 


> — 














• 














: x. 



(-7E6) 



Figure 3. Box-and-whisker plots showing the PD distributions of the five empirical parameters. The range between 5 ,h -95 th percentiles 
is shown by the box. Extreme values are shown by whiskers. Median is shown by a dot within the box. The PD distributions calculated from 1 000000 
Monte Carlo repetitions. ENR for each simulated condition are annotated. Formula for calculation of ENR can be found in Table 1, 
doi:1 0.1 371 /journal.pone.0090300.g003 



Validation of Monte Carlo Error Predictions 

Single pixel DCE-MRI data from pre-treatment scans of all 
tumors (7 VS and 5 meningiomas) was pooled in order to test the 
predictions of the Monte-Carlo modeling process. Surrogate "true 
values" of SQ parameters were developed using the assumption 
that: where CC-TC data shows good agreement with the modified Toft's 
model, the resulting fitted function represents the true underlying CC-TC free of 
noise effects. For this purpose the residual autocorrelation function 
and fraction of modeling information (FMI) [47] is a proper 
quality control for defining the denoised SI curves. 

We therefore use the following approach: 

a. Data for all tumor voxels (n = 117,527) was fitted using a 
modified Toft's model and estimated values of Ii' ms ,v e and Vp 
were derived. 

b. Voxels where the total error is dominated by modeling error 
effects were excluded by examining the FMI (Voxels with 
FMI<0.995 were excluded). 



c. The majority of tumor voxels under this study had a noise 
level of 0.08 to 0. 1 7, corresponding to the simulated data of 
0.10-0.15 noise levels. Voxels with noise level outside the 
range of 0.08-0. 1 7 were therefore excluded. 

d. Voxels with SI(f) curves resembling the typical persistent 
enhancement (0.03<A trans <0.09 min -1 , 0.55<» e <0.90, and 
0.00 1 <» p <0.07) and typical washout patterns 
(0.3<K trans < 1.0 min" 1 , 0.20<» e <0.45, and » p <0.15) were 
identified. The Ranges for values of Ktrans, ve and vp for the 
persistent and washout curves were setup with the consider- 
ation of obtaining enough in vivo curves for the validation 
while keeping the typical persistent or washout type. 

e. Theoretical SI-TC were generated for the selected voxels 
using the measured PK parameters and T lQ values of the 
corresponding voxels. 

f. SQ_ parameters were calculated from the theoretical SI-TC to 
serve as "true values". 
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Figure 2 shows examples of curves used in the PD distribution 
analysis (left column) and of those excluded (right column) based 
on the temporal autocorrelation analysis. 

These voxel selection criteria, outlined above, were used to 
select a subgroup of voxels whose enhancement curves corre- 
sponded very closely to the three principal subtypes identified in 
the Monte Carlo simulation. In addition, although most of the 
voxels in the tumors could be fitted with a scaled fitting error (SFE) 
around 15% or lower, only around one third of the typical 
persistent or typical washout curves could be fitted with a fraction 
of modeling information (FMI) equal to, or higher than, 0.997 and 
these voxels were used in the validation. This resulted in the 
exclusion of the majority of voxels that were represented by mixed 
curve types leaving 8291 voxels with persistent and 448 with 
washout type curves. This selection process is necessitated to 
support direct comparison with the three main curve types selected 
for the Monte Carlo simulation. We therefore divided the 10 6 
Monte Carlo simulated persistent type curves into 100 groups 
(each has 10,000 samples), and the 10 simulated washout type 
curves into 2000 groups (each has 500 samples). PD distributions 
were calculated for each of the subgroups. A range of values for 
each of the descriptive statistics of the PD distribution were 
produced and used for comparison to the in vivo data. 

Comparing therapy-induced changes in PK and SQ, 
parameters. DCE-MRI datasets from pre-treatment, 3 days 
and 3 months post treatment were analysed for each patient. 
Tumors were automatically segmented using high-spatial resolu- 
tion 3D Bayesian probability maps [48]. 3D Parametric maps of 
the five SQ parameters and of ^ tmns ; n v cl and rate constant k ep 
(=ii 1 V» e ), calculated using the modified Tofts model [43,44], 
were generated from each data set. Calculations of SQ parameters 



used a pre-contrast measurement consisting of an average of 5 pre- 
contrast baseline measurements. 

Pre- and post-treatment differences in SQ parameters were 
tested using two samples Wilcoxon rank-sum test for VS and 
meningiomas respectively. Spearman's rank order correlation was 
used to analyze the relationship between A:*" 1115 and each of four SQ 
parameters (MSE, MSE rel , ^MSE, ^MSE rd ) across two tumor 
groups, i.e. VS and meningioma for each visit. 

Since a close correlation between R mse i/ msc 2 an d fep has been 
reported by previous workers [12,31], we used Spearman's rank 
order correlation to analyze the relationship between R se i/ se 2 an d 
k cp across the two tumor groups for each visit and also performed a 
pixel-by-pixel comparison of the pre- and post-treatment values of 
Rmset/mse2 an d Aep using scatter plots and linear regression 
analyses. 

Results 

Monte Carlo Simulation 

1. What is the predicted effect of variations in signal 
intensity curve shape and signal to noise ratio on errors in 
the estimates of SQ, parameters?. Measures for distribution 
characteristics of PD values from the 10 6 Monte Carlo repetitions 
are shown in Table 1 and Figure 3. Table 2 compares the 
descriptive statistics of PD distributions from Monte Carlo 
simulations and in vivo data. The in vivo values for all descriptive 
statistics, in general, lie within the range (minimum and 
maximum) given by the Monte Carlo simulated PD distributions. 

2. Do observations from the clinical DCE-MRI data 
support Monte-Carlo predictions?. Simulation and in vivo 
data demonstrate close agreement and show the following: 



Table 2. Comparison of the SQ parameter PD distributions calculated from Monte Carlo simulations and the in vivo data. 





PD Distribution in 


Min 


5 th Perc. 


Median 


95 th Perc. 


Max 


Persistent MSE 


Sirnul 3 


[-145, -104] 


[-55, 


-52] 


[-2, 1] 


[50,53] 


[105, 147] 




In vivo 


-126 


-54 




-1 


55 


155 


ZMSE 


Sirnul 3 


[-79, -54] 


[-28, 


-26] 


[-1, 0] 


[25,26] 


[51, 80 




In vivo 


-48 


-20 




3 


27 


71 


MSE rel 


Sirnul 3 


[-133, -103] 


[-62, 


-59] 


[-3, -1] 


[84, 92] 


[257, 988] 




In vivo 


-121 


-59 




-1 


81 


529 


£MSE re i 


Simul. a 


[-88, -68] 


[-43, 


-40] 


[-3, -1] 


[60,65] 


[192, 802] 




In vivo 


-58 


-32 




3 


55 


429 


^mse1/mse2 


Simul. a 


[-572, -105] 


[-49, 


-45] 


[-1, U 


[49,52] 


[139, 327] 




In vivo 


-136 


-50 




-3 


50 


209 


Washout MSE 


Simul. b 


[-87, -42] 


[-39, 


-25] 


[-4, 3] 


[25,37] 


[39, 88] 




In vivo 


-67 


-32 




5 


46 


82 


EMSE 


Simul. b 


[-113, -51] 


[-47, 


-30] 


[-5, 4] 


[29,45] 


[46, 1 1 5] 




In vivo 


-59 


-35 




2 


47 


118 


MSE rel 


Simul. b 


[-92, -53] 


[-50, 


-35] 


[-7, 4] 


[49, 86] 


[90, 758] 




In vivo 


-72 


-38 




7 


71 


199 


£MSE re i 


Simul. b 


[-108, -64] 


[-60, 


-42] 


[-9, 5] 


[59, 102] 


[111, 970] 




In vivo 


-65 


-43 




3 


86 


283 


Rmse1/mse2 


Simul. b 


[-7E6, -44] 


[-42, 


-31] 


[-6, 5] 


[70, 186] 


[210, 1E6] 




In vivo 


-1577 


-45 




11 


148 


1862 



a Simul. (Simulated) showed by the range of minimum and maximum from 100 Monte Carlo repetitions. 
b showed by the range of minimum and maximum from 2000 Monte Carlo repetitions. 
doi:1 0.1 371 /journal.pone.0090300.t002 



PLOS ONE | www.plosone.org 



6 



March 2014 | Volume 9 | Issue 3 | e90300 



Semi-Quantitative Metrics for DCE-MRI 



A 




Day 2 





0 0 0 1 0 2 o.l 0.4 0.5 06 V. CCD 026 030 Oft 100 !2> 130 \ft 200 V, 



K op (mirv 1 ) R M i/so2 

Figure 4. Demonstrating direct comparisons between R mS ei/mse2 and /r ep in response to treatment in a single patient, (a) Longitudinal 
spatially co-registered maps of R mse i/ m se2 (t°P) and /c ep (bottom) before (left) and 3 days after bevacizumab treatment (right) from a central slice of 
the tumors, (b) Pixel-by-pixel scatter plots of the parametric values (3 days post-treatment against the pre-treatment) produced from the right 
vestibular schwannoma and the meningioma on the same slice as in (a). The values of R mse i/mse2 were calculated with an average of the five pre- 
contrast baseline measurements as Sl pre , WISE, =MSE lmin and MSE 2 = MSE 5mirl . Mean k sp of VS was 0.30±0.10 on day 0 and 0.19±0.08 on day 3. Mean 
k ep of meningioma was 0.38±0.09 on day 0 and 0.36±0.09 on day 3. Mean R mse i/ mS e2 of VS was 0.82±0.22 on day 0 and 0.68±0.19 on day 3. Mean 
R msel/ mse2 of meningioma was 0.94±.27 on day 0 and 0.94±0.18 on day 3. 
doi:10.1371/journal.pone.0090300.g004 
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1 . Parameters "normalized" using pre-contrast signal intensities 
show poorer precision than non-normalized metrics. SD values 
of PD distributions of normalized metrics were 37%— 94% 
greater than their non-normalized counterparts at noise level of 
5% and 46% — 106% greater at noise level of 15%. In vivo data 
showed that the 90% confidence ranges (range 5 th to 95 th 
percentiles) of the PD for normalized metrics were 22%— 85% 
greater than their non-normalized counterparts and 
82% — 309% greater in the extreme range (range between the 
minimum and maximum values) (Table 2) (23). 

2. YMSE and YMSE„.i show greater precision for persistent and 
lower precision for washout type curves when compared to 
MSE lmin and MSE lmin rel . SD values of PD distributions of 
YMSE and ^MSE^'were 50% and 30% less than for 
MSE lmin and MSE llmn , reI for persistent but 19% -20% 
greater than their non-sum counterparts for washout type 
curves (Table 1). In vivo data confirmed these predictions 
showing that the SD of PD for YMSE and YMSE rel were 57% 
and 38% less than MSE lmin and MSE Imin re i for persistent but 
5% and 18% greater for washout type curves in the 90% 
confidence ranges of the PD (Table 2). 

3. Both simulation and in vivo data showed that: (1) PDs in MSE 
and YMSE are normally distributed (K-S test, p>0.05); (2) PD 
distributions normalized MSE and YMSE show a right skew 
although the K-S test was not significant, 3) the PD distribution 
in R mse i/ mse 2 is not normal with fat tails in the PD distributions 
[49] (K-S test (p<0.001). 

3. Does the behavior of the signal enhancement ratio 
(Rmsei/mse2) provide a satisfactory surrogate metric for 
formal PK based analyses?. Previous studies have recom- 
mended the use of Rmsei/mse2 because it shows correlation with k ep 
[12,31]. In the current study R ms el/mse2 was significandy 
correlated with k ep on day 0 (p = 0.026) and day 90 (p = 0.004), 
although this relationship was not observed on day 3 (p>0.05). 
Figure 4a shows longitudinal coregistered R ms ei/mse2 an d k cp maps 
on day 0 and day 3. Scatter plots of k cp pixel values from day 0 and 
day 3 show correlation (Fig. 4b: i? 2 vs = 0.38; meningioma = 0.57) 



with a clear change in the slope of the regression line reflecting 
treatment induced change in VS (A ep post = 0.48, £ ep , pre +0.05) but 
no change in meningioma (A: ePj post = 0.94, k ep pr[ ,+0.00). Despite 
the expected correlations between the two parameters the 
scatterplot for R mse i/ mS e2 shows weak correlations (Fig. 4: 
ir V s - 0. 19; -^meningioma = 0.23) with reduced separation between 
VS and meningioma. 

In modeling studies R msc i/ mse 2 showed the greatest variability in 
response to noise and PK conditions. R mse i/ mS e2 was much more 
robust for persistent than for washout type curves. Simulations 
showed that SD values of the PD distributions for washout were 
16%, 263% and 2E4% greater than those of persistent type curves 
for noise levels of 5%, 10%, and 15% respectively (Table 1, Fig 3). 
In vivo data confirmed this behavior showing SD values for 
washout 93% greater than for persistent type curves in the 90% 
confidence ranges of the PD, and 897% greater in the extreme 
range (Table 2). 

Comparison of values in msel, mse2, and R m sei/mse2 niaps 
demonstrated that 3 — 4% of voxels have spurious values resulting 
from noise-induced near-zero denominator (se2) values in the 
ration calculation. To remove these outliers, a thresholds of 
0<R ms ei/mse2 < ~ 1 -45 was used to exclude voxels outside the 95 th 
percentile. The denoised Rmsei/mse2 (Rmsei/mse2 (dnj) demonstrates 
treatment-induced changes in VS similar to those seen with other 
SQ metrics. Post-treatment R mS ei/ mS e2 (DN) of VS 3 and 90 days 
after therapy were significantly smaller than pre-treatment 
(p = 0.017; p = 0.026), whilst post-treatment R ms „i/ mS e2 (DN) of 
meningiomas at day 3 showed no change (p>0.05). Post treatment 
Rm.se i/mse2(DN) a t day 90 of meningiomas were significant smaller 
than pre-treatment (P = 0.008). Spearman's rank correlations 
showed Rmsei/mse2 (dn) showed close positive correlation with k ep 
for all three visits. 

4. What is the optimal number of samples to define pre- 
enhancement signal intensity on estimates of SQ 
parameters?. The Monte-Carlo simulation showed that, with 
a 15% noise level (a typical noise level in our data), two pre- 
contrast time frames improved the precision of SQ_ parameter 
estimation with a resulting reduction in the standard deviation of 




Figure 5. Axial view of central slices of 3D longitudinally co-registered kinetic and semi-quantitative parametric maps obtained in 
26-year-old woman, who has had a progressive VS (arrow heads) and an occipital located meningioma (arrow) undergoing 
treatment with bevacizumab. Note that a ring-like structure on the margin of the meningioma can only be seen on the v p maps (arrow), but not 
on any of semi-quantitative maps. 
doi:1 0.1 371 /journal.pone.0090300.g005 
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Table 3. Comparison of mean values of DCE parameters in pre- and post-treatment VS and Meningiomas. 









b Compare Drug-lnd 
Test 


uced Changes of Mean 


in Two Tumors Wllcoxon Rank-sum 


Tumor type 


"DCE- MRI Para-meters. 


Day 0 


Day 3 


Day 90 


VS 


MSE 


86.7±20.2 


63.6±14.0* 


54.4±19.7* 




MSE re , 


1.04±0.19 


0.77±0.17* 


0.65 ±0.23** 




ZMSE 


62.6±14.5 


43.7 ±10.4* 


36.0±14.0* 




£MSE Ie i 


0.75±0.14 


0.54±0.13* 


0.43±0.16** 






1.18±1.18 


0.68±0.01 


0.64 ±0.06 




Rmse1/mse2(DN) 


0.73±0.10 


0.62 ±0.05* 


0.62 ±0.04* 




«i 


0.88±0.03 


0.88 ±0.05 


0.86 ±0.08 




^trans 


0.12±0.01 


0.09 ±0.01** 


0.09±0.03* 




"p 


0.05±0.02 


0.03±0.01* 


0.03±0.01* 




Ve 


0.54±0.07 


0.59±0.13 


0.59 ±0.07 






0.22±0.04 


0.16±0.03** 


0.1 5 ±0.04** 


Meningi-omas 


Rmse1/mse2 


1.00±0.08 


4.91 ±38.2 


0.85 ±0.04** 




Rmse1/mse2(DN) 


0.98±0.06 


0.93 ±0.09 


0.84 ±0.03** 



a MSE, SMSE are in arbitrary unit, MSE re! , ZMSE re i and R mS ei/mse2. ^ep are ratios. K" ans is in minute -1 . 

b Comparison of differences in DCE-MRI parameters between pre- and post -treatment in each group of tumors, i.e. VS (N = 7) and meningiomas (N = 5} for each pair of 

visits (Day 0 and day 3, day 0 and day 90). 

*p<0.05, 

**p<0.01. 

doi:1 0.1 371 /journal.pone.0090300.t003 



PDs of 13%, 24%, 25%, and 31% for MSE, MSE rd , £MSE, anc [ 
YMSE re i respectively for persistent type curves; 13%, 26%, 25%, 
and 3 1 % for washout type curves. The improvement started from 
2 and came to a plateau at time frame 6. The PD distributions of 
normalized metrics were more affected with reduction of positive 
skewness and kurtosis. The precision of R msc i/ mse 2 was l east 
affected by increasing number of pre-contrast time points for 
persistent type curves, but most affected for washout type curves. 

5. How do SQ and PK derived metrics compare in the 
detection of anti-angiogenic therapy induced changes in a 
single centre setting?. Parametric maps of both PK and SQ 
parameters were of high quality (Fig 5). Table 3, and Figure 6 
show mean values of PK and SQ parameters in pre and post- 
treatment tumors. There were no significant changes of longitu- 
dinal relaxation rates Ri (=l/7~i) in VS or meningiomas after 
treatment. In VS; A trans , v p , MSE, MSE rel , ZMSE and 2MSE rel 
and R mse i/msc2(DN) measured on day 3 and day 90 were 
significandy lower than at day 0. From the SQ, parameters, only 
R msel / mse2 showed no significant changes in response to therapy. 
From the PK parameters v e showed no significant treatment 
related change. In meningiomas; R mse i/mse2(DN) measured 90 days 
after treatment was significandy lower than at day 0. Other than 
this there was no significant post-therapy change of PK (i.e. ^ trans j 
v p . v t .) or SQ. (Le. MSE, MSE rel , SMSE, SMSE rel , R m5(;1/mse2 ) 
parameters in meningiomas. 

Table 4 lists correlation coefficients and its significance level 
where the relationships between K trjns and SQ parameters, i.e. 
MSE, MSErei, SMSE and SMSE re i, were tested using Spearman's 
rank order test. Mean values of MSE, MSE rel , SMSE and 
SMSE rc i in VS and Meningiomas were all significantly correlated 
to mean values of _X ,rans on day 0, day 3 and day 90 
(p = 0.002-0.042) with the exception of SMSE„ ;1 measured on 
day 90, which showed only a trend of relationship towards ^* rans 
(£ = 0.076). 



Discussion 

DCE-MRI has become one of the most widely used techniques 
for the characterization of tissue microvasculature with particu- 
larly wide uptake in oncology [3,4,50,51]. Despite this there 
remain significant problems with application and dissemination of 
the technique, largely resulting from variability between imaging 
platforms. In clinical trials this has led to a dominance of PK based 
analysis techniques since it is reasoned, probably correcdy, that the 
use of calculated contrast concentration in place of SI data reduces 
a major aspect of variation [3,4]. However the use of PK metrics 
introduces additional problems including the need to define an 
accurate arterial input function (causing competing demands for 
temporal and spatial resolution), difficulties with measurement of 
pre- and post- treatment Tl values required for calculation of 
contrast concentration, the choice of appropriate pharmacokinetic 
models and the need for curve fitting analyses. The PK approach 
is therefore complex and, until recently, has been largely limited to 
individual centre studies [52]. As a consequence there is wide 
variation in acquisition and analysis approaches [51]. It is 
surprising that, 20 years after the introduction of DCE-MRI 
there is no standardization of acquisition sequences or analytical 
software for clinical or research use despite extensive investment in 
time and resources by academic groups, government and the 
pharmaceutical industry [1,3,4,37,53,54,55]. 

Previous investigators showed the diagnostic importance of the 
shape of time-signal intensity curves [56] in differentiating benign 
and malignant enhancing lesions in breast [19,57,58], hepatic 
Lesion [59], and lesions of bone [60], brain [27], colorectal [61] 
and prostate [62]. Some studies analyzed correlation of CA 
enhancement patterns on MR images with histopathological 
findings and tumor angiogenesis [63,64], and with PET 
imaging[65]. This study analyzed error propagation of SQ 
parameters in three types of Si-time courses, selected on the basis 
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Figure 6. Plots of the changes in each of the SQ and PK parameters for VS during treatment. Error bars represent 95% confidence limits. 
Significant change compared to pre-treatment (paired comparisons) is indicated by stars, * = p<0.05, ** = p<0.01. 
doi: 10.1 371 /journal. pone.0090300.g006 



of these published findings, to investigate these curve shapes' 
preference for robust calculation of SQ parameters. 

SQ parameters "normalized" using pre-contrast signal intensi- 
ties are thought to be necessary to reduce the dependency on both 
biological and imaging variables such as coil filling factor, 
transmitter and receiver gain etc., which vary from scan to scan 
and/or patient to patient [18]. As expected, the normalized 
metrics (MSE rel and ^MSE,^) were found to be more susceptible 
to noise than their non-normalized counterparts (MSE and 



VMSE) and we have confirmed suggestions by previous workers 
that the use of multiple pre-contrast time points to obtain a mean 
value of SI pre , significantly improves estimation errors [46]. We 
have also shown that this benefit is significant when only 2 pre- 
contrast data points are collected and plateaus at 6. In the therapy 
setting J]MSE, MSE, ^MSE re |, and MSE rel , correlated with and 
showed similar behavior to K rms , [66,67]. The predicted and 
observed error distributions in SQ parameters described here 
could be considered a disadvantage to their use in clinical trials. 



Table 4. Spearman's rank order correlation between K trans and SQ parameters, i.e. MSE, MSE re |, £MSE and ZMSE re |. 







MSE 




MSE rel 




IMSE 




lMSE rel 




Est.* 


p-val 


Est. 


p-val 


Est. 


p-val 


Est. 


p-val 


Pre-treatment 


0.776 


0.010 


0.734 


0.015 


0.699 


0.020 


0.650 


0.031 


Day 3 


0.839 


0.015 


0.885 


0.003 


0.692 


0.022 


0.727 


0.016 


Day 90 


0.937 


0.002 


0.818 


0.007 


0.609 


0.044 


0.538 


0.076 



*Est.: Estimate. 

doi:1 0.1 371 /journal.pone.0090300.t004 
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However, similar Monte-Carlo modeling analyses of PK analytical 
approaches have demonstrated not only noise related errors, equal 
to or greater than those described here, but also systematic bias 
resulting in very poor precision in K tranh at low values, particularly 
the presence of low SNR [29]. 

The signal enhancement ratio (R mse i/ mse 2) is little affected by 
variation in tissue T 10 values and has been shown to correlate 
closely with the redistribution rate constant (k ep ), a commonly 
analyzed PK parameter [31]. This makes R mse i/mse2 a potentially 
attractive and very widely used metric, particularly in breast 
cancer studies [9,10,11,12,13,32,33,34,35,36]. However, in the 
majority of these studies R mse i/mse2 was measured on an averaged 
SI curve from a region of interest producing high SNR [12]. We 
have shown that single pixel mapping is associated with poor SNR 
and considerable heterogeneity in data quality. We demonstrated 
that R m sei/msc22 h as poor tolerance of low SNR, which is 
particularly severe when it is calculated from washout type curves. 
The outiiers identified from both simulation and in vivo R mse i/mse2 
lead to high kurtosis and skewness in the PD distribution function. 
It is clear that these outliers should be carefully treated prior to 
statistical analysis. It is encouraging that, as shown in this study, 
the method using 95 th percentile as a threshold for the removal of 
outliers has demonstrated efficacy in restoring the power of R msc i/ 
mse2) in detecting the therapy-induced changes and resulted in the 
demonstration of therapy induced changes in meningiomas which 
were not detected by other SQ_ or PK parameters. Use of an 
Rmsei/mse2 histogram based volume analysis is an alternative 
approach that is also less affected by outiiers [11]. 

One of the major stated benefits of the PK analytical approach 
is the physiological specificity of the metrics. When DCE-MRI 
studies of antiangiogenic therapies became common, K mns was 
widely used as an indicator of changes in endothelial permeability. 
In fact it represents a compound metric affected by both blood 
flow and the product of the surface area and permeability of the 
capillary endothelial membrane. Nonetheless, the use of K ^ as a 
biomarker effectively removes confounding effects due to varia- 
tions in Vp and v e . The statistical power of any given metric to 
detect significant change is dependent both on the change in 
mean/median value and, more importantly on the shape and 
width of the data distribution. In this study, the group coefficients 
of variation for SQ_metrics in VS ranged from 18-24%. However, 
the CoV for K trans was considerably less both at day 0 and at 3 
days of treatment (COV 8.3 and 11% respectively). This was 
associated with very high COV for v p (40 and 33% respectively). 
This narrow distribution resulted in improved statistical power for 
K trans compared to SO_ metrics such that a 25% reduction in K trans 
at day 90 produced similar significance values to 37%, 37%, 42% 
and 43% decreases in MSE, MSE rel , YMSE anr i VMSE re , 
respectively. The reasons for this difference in COV is not clear, 
however it seems likely that the systematic removal of the 
contributions of intravascular contrast (v p ) removed a significant 
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source of variation from the estimated mean tumor values. 
Interestingly, the denoised signal enhancement ratio (R msc i/ 
mse2(DN)) also demonstrated low COV (13.7%, 8.0% and 6.4% at 
days 0,3 and 90) and showed treatment induced changes of similar 
significance to K mns despite a reduction of only 15.1% in mean 
values. In meningiomas pre-treatment K tr ' ms had the largest COV 
of any metric other than v p (40% and 60% respectively). R msc i/ 
mse2 (DN) showed the lowest COV (6.1%, 9.6%, and 3.6% at days 
0, 3 and 90) and was the only metric to demonstrate significant 
therapy induced changes with a reduction in mean values of 14% 
compared for example to non-significant reduction in mean K ep of 
13%. The R mS ei/mse2(DN) parameter is also designed to remove 
confounding numerical effects from estimates of the mean value. 
These results demonstrate the importance of variation in the mean 
estimated values of each parameter across the tumor population 
and favour the use of parameters where variation is minimized by 
choice of the appropriate metric, whether SQ_ or PK. Unfortu- 
nately the difference in behavior between meningiomas and VS 
shows that the potential variation in individual metrics may be 
tumor specific and cannot be predicted during trial design. These 
observations also support the suggestions of previous workers that 
analysis of DCE-MRI data should ideally be performed on a pixel 
by pixel basis [2,3] and that the effects of spatial heterogeneity 
should be specifically included into the analytical approach [68]. 

In conclusion, this study begins to challenge the commonly 
expressed criticisms of SQ_ metrics for pixel-by-pixel parametric 
mapping and clinical trials. The SO_parameters in this study show 
relatively high tolerance to poor SNR compared to previous 
studies of PK metrics and demonstrated equivalent therapy 
induced changes. This paper is deliberately controversial and the 
majority of reviews and consensus workshop reports on DCE-MRI 
favor PK over SQ_ metrics for the reasons discussed above. 
However we believe that the results presented here demonstrates 
some clear advantages of SQ_ metrics and supports a re-evaluation 
of the utility of these metrics, which must include comparative 
studies of baseline reproducibility and multi-vendor/ multicenter 
implementations . 
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